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Abstract 

An order theoretic and algebraic framework for the extended real numbers is es- 
tablished which includes extensions of the usual difference to expressions involving — oo 
and/or +00, so-called residuations. Based on this, definitions and results for directional 
derivatives, subdiffcrentials and Legendre-Fenchel conjugates for extended real-valued 
functions are given which admit to include the proper as well as the improper case. For 
set- valued functions, scalar representation theorems and a new conjugation theory are es- 
tablished. The common denominator is that the appropriate image spaces for set-valued 
functions share fundamental structures with the extended real numbers: They are order 
complete, residuated monoids with a multiplication by non-negative real numbers. 
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1 Motivation and bibliographical comments 

Without any doubts, the notion of an extended real-valued function turned out to be ex- 
tremely useful in variational analysis, optimization theory and beyond. On the one hand, 
several operations like taking the directional derivative or the infimal convolution, even per- 
formed on real-valued or proper functions, may lead to functions which also attain the values 
+00 and/or —00, and it would be really awkward to exclude such cases (see already |12[ p. 
167]). On the other hand, the added element +00 admits the inclusion of constraints in a 
very elegant and concise way (compare [T?H P- 23]). 

Almost all textbooks and relevant papers on convex and variational analysis make use 
of this notion. As examples we mention [TB], [H], [IS]) [20], [3]> [12]) all already published 
before 1980. 

To our opinion, the most thorough investigation of extended real-valued functions has 
already been made by Jean Jacques Moreau in [13], [15], [16]. It is a stunning and startling 
fact that his attempt to "algebraize" the extended reals was not exploited consequently later 
on. Compare [2U1 p. 6], and [21 p. 9], where the operation (+00) + (— 00) is called "risky" and 
"undefined and forbidden", respectively, and also the classic |19|. p. 24]. Even in the more 
recent [21} p. 15], the authors state "there's no single, symmetric way of handling 00 — 00". 

Most authors try to avoid the difficulties (like in |18t p. 38]: "we won't have occasion to 
worry about +00 — 00 or • 00") by restricting the theory to proper functions or just ignore 
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the problem. An extreme with respect to this "avoiding approach" is the standard volume on 
infinite dimensional analysis [U p. 2] which reads "The combination +00 — 00 of symbols has 
no meaning. The symbols +00 and —00 are not really meant to be used for arithmetic, they 
are only used to avoid awkward expressions involving infima and suprema." In this note, we 
show that just the opposite works well. 

To avoid the development (or the use) of an arithmetic for the extended reals does not 
only passes a chance, it may also lead to imprecise statements. An example for the latter 
can even be found in otherwise impressive textbooks: Theorem 2.3.1, (ix) in [23] does not 
hold for improper functions (no such assumption made in the quoted reference) unless one 
uses the inf-addition on the left and the sup-addition on the right hand side (see below for 
definitions) of the equation (/□<?)* = f*+g*. The same remark applies, for example, to the 
first part of theorem 1 in \12\ Section 3.4, p. 178]. 

In this note, we give an extension of Moreau's approach to extended real- valued functions 
by noting that the correct algebraic framework is an order complete, residuated monoid 
with a multiplication with non-negative real numbers. The advantage of this complicated 
sounding construct is manifold: First, there is no need anymore to "explain away" the value 
—00 or to introduce algebraic rules for expressions like (+00) + (— 00) "by convention" ( |21l 
p. 15]), or to avoid them. Secondly, new operations can be introduced which give a precise 
meaning to expressions like (+00) — (—00), and one obtains a whole calculus for addition 
and residuation/difference in IR = IR U {—00} U {+00}. On an abstract level, some of these 
observations have already been made by Martmez-Legaz, Singer and Getan in [13] and [6]. 

Moreover, our approach will also simplify the notation avoiding symbols like r -j — s (see, 
among others, Moreau's papers, \13\ example 2.3], [23]). Finally, it will become clear that 
the theory is completely symmetric, because our slightly different point of view (compared 
to Martmez-Legaz, Singer and others) is that there are two different ways for introducing 
algebraic and order structures in IR and more general sets as shown in the section about 
set-valued functions. This follows Moreau's original idea of defining convex and concave 
functions using different additions and image spaces. 

Since we consequently work with two algebraically different copies of the extended reals, 
we have to say which of the two is used as an image space if we define an extended real- 
valued function. Thus, there are two classes of such functions. Not very surprisingly, the 
multiplication by —1 transfers a function of one class into one of the other, an operation which 
is nothing else than a duality in the sense of [23]. We show how these concepts can be used, 
for example, to define directional derivatives and subdifferentials of improper convex/concave 
functions in a coherent way. 

A second new feature of our approach is that in order to obtain complete (duality) results 
the set of dual variables is extended by improper elements and, moreover the definition of the 
Legendre-Fenchel conjugate is altered: the new definition involves an additional real variable 
which comes from the idea that the conjugate should be defined on the set of affine functions 
rather than on the set of linear functions. It does not make a difference if the function is 
proper, but is does if not since the improper "linear" functions are not additive. A somehow 
surprising result is that the conjugate of the infimal convolution of two functions turns out 
to be the supremal convolution of their conjugates - with respect to the new primal variable. 

We mention that improper affine functions have been used in [17] in order to formulate 
duality results for optimization problems involving set-valued maps. We are not aware of 
further references, but we think there should be some. 
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Finally, we consider set-valued functions and give an extension of the theory formulated 
in [8] to improper set-valued functions using the (improper) scalar ones. In fact, the present 
note has been written since we wanted to have a coherent framework for proper and improper 
scalarizations of (closed convex) set-valued functions. The approach follows ideas of |22j : 
In particular, using the representation of set-valued closed convex functions by families of 
extended real- valued ones we give a new definition of Legendre-Fenchel conjugates for set- 
valued functions and conclude with a Fenchel-Moreau theorem which includes the proper as 
well as the improper case. 

We conclude the introduction by noting that it does not take more than 5 pages and 
relatively elementary mathematics to introduce the two possibilities for an algebraic and order 
theoretic framework in IR, which seems affordable for classroom and textbook purposes. 

2 A basic result from residuation theory 

In this section, we consider a lattice ordered set with an algebraic operation which we call 
addition, denoted by +, since it corresponds to "usual" additions in most special cases we 
have in mind. In the following, we understand by a partially ordered groupoid a nonempty 
set W with a binary relation + : W x W — > W and a partial order < which are compatible: 
u,v,w E W and u < v imply u + w < v + w. The sum u + M of u £ W and M C W is 
understood in the Minkowski sense with u + M = if M = 0. The following theorem can be 
extracted, for example, from f5, chapter XII]. See also [131 proposition 2.6], [61 proposition 
2.1] for parts (c), (d). 

Theorem 2.1 Let (W, +,<) be a partially ordered commutative groupoid. The following 
statements are equivalent: 

(a) For each u,v €W there is w E W such that for w' 6 W 

u < v + w' w < w'; 

(b) For each u,v G W the set {w' £ W : u < v + w'} has a least element; 

(c) For u E W and M CW such that inf M exists it holds 

u + inf M = inf (u + M) ; 

( d) For each u,v €W there exists inf {w' € W : u < v + w'} € W and it holds 

u < v + inf |k/ G W: u < v + w'} . 
Proof. The equivalence of (a) and (b) is obvious. Assume (a). Then 

Mm 6 M : u + inf M < u + m, 
hence u + inf M is a lower bound of u + M. On the other hand, let w G W such that 

Mm 6 M : w < u + m. 
By assumption, there is w € W such that 

w < u + w 44> w < w' . 
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Hence w < m for all m € M and therefore w < inf M. Again by assumption w < u + inf M 
which proves that u + inf M is the infimum of u + M. 

Assuming (c) we define to = inf {w' € W : u < v + w'}. Then 

u < inf \ v + u/ : vJ € W, u < u + u/} = u + inf \w' £ W : u < v + u;'} = v + u;. 

(c) 

Now, from (c) it follows 

v < ini {u + w' eW : v < u + w'} = u + inf {w' eW:v<u + w'} , 
i.e. (d) holds true. 

Finally, assume (d) and define M = {w £W: u < v + w}. Then, by assumption, inf M € 
W and 

u <v + w <^4> w G M <3> inf M <w 

which proves (a). 

This completes the proof of the theorem. □ 

We shall call a partially ordered commutative groupoid satisfying the conditions of the- 
orem 12.11 inf-residuated. The following theorem can be proven with parallel arguments and 
gives conditions for sup-residuated groupoids. 

Theorem 2.2 Let (W, +, <) be a partially ordered commutative groupoid. The following 
statements are equivalent: 

(a) For each u,v £W there is w € W such that for w' G W 

v + w' < u <^=^> w' < w; 

(b) For each u, v € W the set {w' G W : v + w' < u} has a greatest element; 

(c) For u EW and M CW such that supM exists it holds 

u + sup M = sup (it + M) ; 

(d) For each u,v E W there exists sup{ui' EW:v + w'<u}eW and it holds 

v + sup \ w' G W : v + w' < n} < u. 

3 An algebraic approach 

3.1 Order extension 

Adding two elements — oo, +oo to the set 1R of real numbers we consider the set 1R = 
1R U {— oo} U {+00} and extend the usual order relations <, < on 1R to 1R by setting 

VrGlR: — 00 < r < +00 
VVeIR: — 00 < r < +00. 
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With this extension of <, (IR, <) becomes a partially ordered, complete lattice: Every subset 
has an infimum and a supremum. In particular, 

inf0 = supIR = supIR = +oo, (3.1) 
inf M = inf IR = sup = -oo. (3.2) 

Note that the commonly used conventions inf = +oo, sup0 = — oo are the unavoidable 
choice if one wants to maintain the following monotonicity property: M C N C IR implies 
inf M > inf N and sup M < sup N. 

3.2 Addition 

There are two ways to extend the addition from IR to IR by means of the order relation <. 
We obtain two different algebraic operations in ]R. 

Definition 3.1 The binary operations +" : IR x IR — >• IR and +. : IR x IR — > IR defined by 

r+'s = inf {a + b: a, 6 G IR, r < a, s < b} (3.3) 
r+ m s = sup {a + b: a, b G IR, a < r, b < s} (3-4) 

for r, s G IR are called the inf- addition and the sup- addition in IR, respectively. 

The terminology is due to [21] . Already Moreau p2| introduced the two different additions 
in IR. Clearly, both operations coincide with the usual addition on IR. The notable differences 
are 

(+oo) +" (-co) = (-oo) +" (+oo) = +oo, 
(+oo) +. (-oo) = (-oo) +. (+oo) = -oo. 

Since inf-adding +oo always gives +oo as a result, we say that +oo dominates the inf-addition. 
Likewise, — oo dominates the sup-addition. Both operations are compatible with the order < 
on IR in the usual sense. Thus, (IR, +■ , <) and (IR, +. , <) are ordered commutative monoids 
which are complete lattices. The following result describes the relationships between inf- 
/sup-addition and the order relation. Compare, for example, [H], proposition 1 and 2 with 
F = M, G = N and / (x) = g (x) = x. 

Proposition 3.2 Let M,N CM. Then 

inf (M+" N) = inf M+ - inf N, sup (M+" N) < sup M+ - sup N (3.5) 
inf M-h inf N < inf (M± N) , sup M+ m sup N = sup (M+. N) (3.6) 

where the sum of sets is understood in the Minkowski sense. 

PROOF. By definition, 

inf M+- inf N = inf {r + s : r, s G IR, inf M < r, inf N < s} 

and for all m G M,n G N holds inf M+ 1 inf N < m+n, thus inf M+- inf N < inf (M+ m N). 
On the other hand, if M = or N = 0, then both of inf M+- inf N and inf (M+- N) give the 



5 



result +00 since the latter element dominates the inf-addition. If M, N ^ and one of them 
has infimum —00 then inf M+" inf N = inf (M-piV) = —00. If —00 < infM, inf N then, for 
each e > there are m £ G M Pi IR, n e € A" n IR such that m e + n e < inf M+" inf A~ + e, hence 
inf Af+" inf A" < inf (M+ - A 7 ") which gives, together with the first part, equality. □ 

In particular, with r G IR, A" = {r} we obtain (again, compare [2], p. 7, formulas (2.9), 
(2.12)) 

r+" inf M = inf ({r} +" M) , r+. sup M = sup ({r} +. M) . (3.7) 

Finally, note that the inequalities in (|3.5p and (|3.6p are not satisfied as equations in general. 
A counterexamples can already be found in |15j . p. 7. 

3.3 Multiplication with -1 

By setting 

(-1) (+00) = -00, (-1) (-00) = +00 

we extend the multiplication of real numbers with —1 to IR. As usual, we abbreviate (—1) r 
to — r for r G IR if no confusion arises. Obviously, 

Vr, s G IR: (r < s -£4> — s < —r) 

and hence for each M C IR 

(-1) infM = sup (-l)M. (3.8) 

Thus, the multiplication with —1 is a duality of IR onto itself in the sense of [23], chapter 5. 
Here and in the following, we make use of (— 1) M = {— r : r G M} if M ^ and (—1) M = 
if M = 0. 

Proposition 3.3 For r, s € IR, 

(-1) (r+-s) = (-l)r+. (-l)s. 

Proof. Using definition 13.11 and 13.81 above we obtain 

(-1) (r+"s) = (-1) inf {a + 6: a, 6 G IR, r < a, s < b} 

= sup {(—a) + (—b) : a, b G IR, r < a, s <b} 
= sup {a' + 6' : a', b' G IR, a' < — r, 6' < — s} 
= (-l)r+.(-l) S 

which already proves the claim. □ 

3.4 Residuation and inf-/sup-difference 

Proposition 13.21 together with theorem 12.11 and 12.21 tell us that (IR, +" , <) and (IR, +. , <) 
are residuated semigroups with a neutral element (i.e. residuated monoids), see e.g. [5], 
chap. XII. The corresponding residuation operations may serve as extensions of the difference 
from IR to (IR, +" , <) and (IR, +.,<), respectively. This motivates the following definition. 
Residuation operations for x 1— > r + x in IR have not been considered by Moreau. Only 
Martmez-Legaz, Singer and Getan (see [13] . [6]) seem to have realized the importance of 
residuation for the foundation of convex analysis. 
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Definition 3.4 Let r, s € IR. The element 

r— s = min \ t € IR: r < s+" i} 

is called the inf- difference of r and s. The element 

r— s = max jt € IR: s+. t < r} 
is called the sup- difference of r and s. 
One easily obtains for all r, s £ IR 



r- s = inf {t £E: r<s+'t}, (3.9) 
r- s = sup{i € IR: s+ m t < r} (3.10) 



and 



r— (+oo) = — oo, (— oo) —' r = — oo, (3-11) 
r— (— oo) = +oo, (+oo) — r = +oo. (3-12) 

The rules for a subtraction of least and greatest elements from each other are as shown below: 

(+oo) - (-oo) = +oo, (+oo) - (+oo) = +oo, 

(+oo) — 1 (+oo) = — oo, (+oo) — (— oo) = +oo, 

(— oo) — 1 (+oo) = — oo, (— oo) — (— oo) = +oo, 

(— oo) — 1 (— oo) = — oo, (— oo) — (+oo) = — oo. 

Moreover, from theorem 12.11 (a) with n = rG IR, v = s€lR, w = r—s and w' = 0, and 
likewise with the help of theorem 12.21 we obtain 

r < s <^ r-s < & < s-r. (3.13) 

The following result gives relationships between inf-/sup-addition, inf-/sup-subtraction 
and multiplication with —1. 

Proposition 3.5 Let r,s G IR. Then 

r-- s = r+, (-l)s, (3.14) 

r-s = r+- (-l)s, (3.15) 

s-r = (-1) (r-s) , (3.16) 

s-r = (-l)r- , (-l)s, (3.17) 

s-r = (-l)r-(-l)s. (3.18) 

Proof. If r = — oo, or if s = +oo, then r—s = r+. (—1) s = — oo, see f)3.11j) . If r = +oo 
and s < +oo, or if s = — oo and r > — oo, then r—s = r+. (—1) s = +oo. This proves (I3.14j) 
since if r, s £ IR, the formula is known to be true. Likewise, (|3.15p is proven. 

Next, we use (13. 8p and (13.9P to obtain 



(-l)(r-s) = sup{t € IR: r < s+ m {-l)t} . 
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Since it suffices to take the supremum over t 6 IR we get 



r<s+'(-l)i ^ r+.t < s 



and (|3.16|) follows from definition 13.41 

The last two equations are immediate from (|3.14p . (|3.15p . □ 

We establish a calculus for manipulating inf-/sup-differences. Since these operations are 
special cases of residuation mappings these rules are well-known, see for example [H Lemma 
3.2] where the sup versions can be found. 

Proposition 3.6 (a) For each r € 1R ; 

: r£E f : r 6 IR 

r— r = < , m , r— r 



-co : r IR ' 1 [ +oo : r^E 
(b) For each r, s, t € IR wrai/i r < s, 

r—t < s—'t, t—'s < t—r, 



and 

(c) For each a, b, r, s € IR, 



especially 
Symmetrically, 
especially 
(d) If M CE and a € IR, t/ien 



r—t < s— t, t— s < t—r. 

(a+T)-(6+'a) < (a-6)+'(r-s), 

(a+"r)- (r+"6) < (a- 6). 
(a-6)+.(r-a) < (a+.r)- (6+. a), 
(a-.fe) < (a+.r)-(r+.b). 



a— inf M = sup (a— 1 m), 

a— supM= inf (a—m). 

meM " 

Proof, (a) is straightforward from the definitions. For (b) observe that if r < s, then 
s < t+ - t' implies r < t+ - t', and this in turn gives r—t < s—t. Moreover, if r < s, then 
t < r+'t' implies i < s+'t', and this in turn gives i— "s < t—r. The relationships for — can be 
proven similarly. We turn to (c). Take £i,i2 € IR such that a < b+'t± and r < s+'t2- Then 
(a+- r) < (b+- s) +■ (ti + t 2 ), hence 

(o+t) - < £i+-i 2 - 

Taking the infimum over ii satisfying a < 6+"£i and £2 satisfying r < s+"t2 gives the result. 
The second formula in (c) is immediate by setting r = s in the first and applying (a). 
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The results for — are proven likewise, (d) Using (|3.14p . (|3.15p as well as (|3.8p and (e) of 
proposition 13.51 we obtain 

a- MM = a+. (-1) inf M = a+. sup-M = sup (a+. (-M)) = sup (a-M) . 

The second equation follows from the first since by (|3.15p we have a— sup M = a+' inf (— 1)M 
and thus a— supM = inf (a— m). □ 

3.5 Multiplication with non-negative reals 

The multiplication with non-negative reals is extended to 1R by 

\ft > 0: t ■ (±oo) = ±oo 

and 0- (±oo) = € IR. The triples (]R, +' , •) and (lR, +. , •) are conlinear spaces (see appendix 
for a definition) consisting only of convex elements. That is, the multiplication with non- 
negative real numbers distributes over +" and +. as well as the other way round. 

The order relation < as defined above is compatible with this algebraic structure in the 
usual sense. We write IR A = (IR, +" ,-,<), 1R V = (lR, +.,-,<), and drop the • for multiplica- 
tion if no confusion arises. 

Proposition 3.7 For all a, b € IR and t > it holds 

t(a— b) = ta— tb, t(a— b) = ta— tb. 

Proof. The relationships are trivial for t = 0. If t > then 

t(a-b) = inf {ts € IR: a < 

= inf {a' € IR: ta < tb+- s'} = ta- tb. 

The result for — , follows similarly. □ 

4 Extended real-valued functions 

From the above, it should be clear that there are two types of extended real-valued functions, 
those mapping into 1R A and those mapping into 1R V . The point- wise multiplication with — 1 
transfers a function of one class into a function of the other. This point of view differs slightly 
from [6] where (only one copy of) IR is considered with two additions and two corresponding 
residuation operations. This might appear to be just a tiny shift of weight, but it becomes 
important when it comes to set-valued functions: The replacements of IR A and IR V will have 
rather different looking elements. 

Definition 4.1 Let f : X — > IR. The epigraph and the hypographs of f are the sets 

epi/ = {(x,r) € X x IR: / (x) < r} , hypo/ = {(x,r) £ X x IR: r < / (x)} , 
respectively. The effective domain of a function g : X — > IR A is the set 

domg = {x € X : g (x) < +00} 
whereas the effective domain of a function h : X — > IR V is the set 

dom h = {x € X : — 00 < h (x)} . 
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The concept of the domain depends on the image space, so if one knows the latter, one also 
knows which definition to use. Therefore, we do not introduce different symbols. Note also 
that the collection of functions into IR A (IR V ) is a conlinear space under point-wise addition 
+' (+. ) and multiplication with non-negative reals, but neither collection is a linear space. 
Mixing up the image spaces may lead to strange effects as the next example shows. 

Example 4.2 Consider the functions f,g: IR — > IR A defined by 



Both functions have a convex epigraph. So has the function 14/ (x) +" 9 {%)■ However, the 
function x 1— > / (x) +. g (x) neither has a convex epigraph nor a convex hypograph. 

The previous example also shows that convexity and +" are linked as are concavity and 
+. • This justifies the following definition (already in |14t p. 19]. 

Definition 4.3 A function g: X — > 1R A is called convex if 

Vt G (0,1), Vxi,x 2 £l: g(tx! + (l-t)x 2 ) < tg (xi) +" (1 - t) g (x 2 ) . 

A function h : X — > 1R V is called concave if 

Vf G (0, 1) , Vxi, x 2 G X: th {x x ) ± (1 - t) h (x 2 ) < h {tx\ + (l-t) x 2 ) . 

Again, the collection of all convex functions into IR A (concave functions into IR V ) is a 
conlinear space under point-wise addition +" (+. ) and multiplication with non-negative reals. 
Apparently, it does not make much sense to consider convex functions into IR V or concave 
into IR A . 

A function g: X — > IR A is convex if and only if —g: X — >■ IR V is concave. A function g 
mapping into K A is convex if and only if its epigraph is a convex subset of the linear space 
X x IR, and a function h mapping into IR V is concave if and only if its hypograph is convex. 



A positively homogeneous convex function into IR A is called sublinear, and a positively homo- 
geneous concave function into IR V is called superlinear. 



Notice that we do not include the case t = in the definition of positive homogeneity. 
Thus, 




Definition 4.4 A function f : X IR is called positively homogeneous if 



Vt > 0, Vx G X : f(tx) = tf{x) . 




is a positively homogeneous function, while • g{x) 7^ g(0 ■ x) holds for all x G X. 
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Example 4.5 (improper afflne functions) Let X be a topological linear space and X* its 
topological dual. We write x* (x) for the value of an element x* G X* at x G X . Let r G IR 
and set x*(x) = x*(x) — r for x G X. Each x* € X* generates a closed improper function 
x* : X — s> IR A given by 

— oo : x* (x) < 
+00 : x* (x) > 

which we call inf-extension of the affine function x 1— > x*(x). Analogously, the improper 
sup-extension of x 1— > x* (x) (with a closed hypograph) mapping into IR V can be obtained by 
reversing the roles of —00 and +00. The functions Xq are positively homogeneous, subaddi- 
tive and superadditive, but not additive, i.e. in general Xq {x\ + X2) 7^ Xq (xi) +"Xg (x 2 ) for 
x\,X2 G X. Below, this will force us to define Legendre-Fenchel conjugates acting on the set 
of affine rather than linear functions. 

In the sequel, we shall write x* for Xq and x* for Xq. Define 

X* = {x*: x* G X*} 

and X A = X* U X* . The set X^ is called the (topological) inf-dual of X (correspondingly, 
the sup-dual X v of X can be defined using the sup-extensions of continuous linear functions). 
On X A , an addition can be introduced by 



inf-extension of x* + y* 

x* + y* 



K=x ,T] = y 
£ = x*,rj = y* 

4 = x ,v = y 



for £, r/ G X A with x*,y* G X*. Taking the multiplication by non-negative numbers pointwise, 
(X A , +, •) is a conlinear space with neutral element G X* . 

The following representation formulas for (proper and improper) affine functions will be 
used later on. 

Proposition 4.6 Let £ G X A , r G IR. Then 

Vxi,x 2 G X: £ r (xi + x 2 ) = sup [f n (xi)+.£r 2 (x 2 )] , (4.1) 

ri+r2=r 

Vxi,x 2 e X: £ r (xi - x 2 ) = sup [£ n (x x ) -£- r2 (x 2 )] . (4.2) 

ri+r2=r 

Proof. Exemplarily, we prove (|4.ip . The formula is obvious for £ = x* G X* and for 
£ = 0*. Let £ = x* G X*\ {0*}. Then, by definition of x* and since —00 dominates the sup- 
addition sup {x^ (x) +. x* 2 (y) : r\ + r 2 = r} = +00 if and only if there is T\ + r 2 G IR such 
that x* (x) — r > and x* (y) — r > and ri + r 2 = r. But this is equivalent to x* (x + y) — r > 
0, and this in turn to x* (x + y) = +00. Otherwise, x* (x + y) = sup (x* x (x) +. x* 2 (y)) = 

J*i+r2=r 

— OO. □ 

Replacing sup by inf, +. by +■ and — by — . one may obtain another pair of representation 
formulas. 
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5 Applications 

5.1 Directional derivatives of convex functions 

In this section, we shall show that the residuations — and — may serve as substitutes for 
the usual difference in the definition of the directional derivative of extended real-valued 
convex and concave functions. Besides the obvious result (may be useful or not) of having 
a coherent definition of directional derivatives also for improper functions the constructions 
below indicate the deep connection between the order relation in the image space, crucial for 
the definition of residuations, and directional derivatives. 

Definition 5.1 The directional derivative of a function g: X — > IR A at x$ £ X in direction 
x G X is given by 

g (x ,x) = 1 im- [(# ( x o + tx) -g (x ))] . 

The directional derivative of a function h: X 1R V at xq £ X in direction x £ X is given 
by 

h! (xq, x) = lim - [{h (xo + tx) — h (xo))] . 

If g (xq) = +oo then g' (xq, x) = — oo since r— (+oo) = — oo for all r £ IR. If g is convex 
and g (xo) = — oo then g' (xo, x) = — oo iff there is t > such that g {xq + tx) = — oo and 
g' (xq,x) = +co otherwise. If g (xq) € IR the directional derivative coincides with the classical 
one (see e.g. [12], p. 193). Similar remarks apply to h! (xo,x). 

Remark 5.2 We have g' (xq,x) = (—l)(—g)'(xQ,x) and similar for h. This can be seen 
with the help of proposition HOI 

Proposition 5.3 If g: X — > IR A is convex, then x i— > g' (xo,x) is a sublinear function from 
X into IR A . In this case, 

g' (x ,x) =inf ^ [(g (x + tx) - g (x ))] . (5.1) 

Likewise, ifh:X^ IR V is concave, then x i— > h! (xo,x) is a superlinear function from X into 
IR V and 

h (xo, x) = sup - [(h (xo + tx) — h (xq))] . (5-2) 

i>0 t 

Proof. The basic fact is the monotonicity of the difference quotient 

* ^ \ [{9{xo + tx) -g(x ))) • 

Indeed, taking t > and r € (0, 1) we obtain with the help of proposition 13.61 (c) and 
proposition 13.71 

1 t 1 — r 

~ t [9 (xo + rtx) -g(x )] < — [g (x + tx) - g (x )] +" — — [(g(x )- g(x ))] 

< - [g(xo + tx) -g(x )] • 
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Therefore, for < s = rt < t 

- [(g {xo + sx) - g (x ))] < - [(g (x + tx) - g (x ))] 

and hence 

g' (x ,x) =|nf- [(g (x + tx) - g (z ))] 

holds true. For s > 0, 

5 (x ,sx) = s ■ inf — [(y (x + six) -g (x ))l = sg' (x ,x) , 

st>0 st 

thus the directional derivative is positively homogeneous. 
Finally, consider the function gt : X — > IR A defined by 

9t(x) = - (g(x + tx)-g(x )) for x € X. 

The epigraph of each function gt is convex and by the monotonicity of the difference quotient, 

epiy'(x , ■) = (J epiy t 
*>o 

is convex. Thus, the directional derivative is a sublinear function. 

The concave case is immediate, considering that h is concave iff —h is convex. □ 

The first part of the previous proposition is an extension of results like theorem 2.1.13 in 
[24] . In the "proper" theory, it is well-established that the linear minorants of x t— > g' (xq,x) 
are precisely the elements of the sub differential of g at xq. Admitting improper affine functions 
(see example 14. 5p it is now possible to formulate an "improper" supplement for the "proper" 
theory. Recall X A = X* U X* (see example S3]) . 

Definition 5.4 An element £ G X A is called an extended subgradient of g: X — > IR A at 

x £X iff 

VzeX: £(x-x ) <g(x)-g(x ) (5.3) 

The set of all subgradients of g at xq is denoted by d ex g(xo), the set of improper subgra- 
dients of g at xq is denoted by d tp g(xo), and the (classical) subdifferential is dg {xq) = 
d ex g(x )\d ip g(x ). 

Obviously, — oo € d ex g (xq) for all g and all xq € X. 

Proposition 5.5 Let g: X — > ]R A be a convex function. The following two statements are 
equivalent for £ € X A , xo € X: 

(a) £ is a subgradient of g at xq; 

(b) \fx G X: £(x) < g'(x ,x). 

Proof. First, assume (a) and choose x = xq + ty with t > 0, y G X. We get 

Vy € X, Vt > 0: £ {ty) < g (x + ty) g (x ) . 

Since j£ (iy) = £ (y) for all t > 0, y G X (no matter if £ is proper or improper) we may 
conclude 

Vy G X, Vt > 0: £ (y) < - [g (x + ty) -■ g (x )] . 
Formula (15. ip produces (b). Next, assume (b). Using (15. lj) and choosing t = 1 gives (15. 3h . □ 
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5.2 Legendre— Fenchel conjugation 

The following concepts and results supplement the conjugation theory for functions with a 
proper closure. Throughout this section, we assume that X is a separated locally convex 
space with topological dual X* . It is well-known that if g is convex and improper, then 
(clg)(x) G {±00} for all x G X (see (2H proposition 2.2.5]). In this case, dom (clg) = 
cl (dom g). 

Theorem 5.6 Let g: X — > IR A be improper closed convex. Then g is the pointwise supremum 
of its improper closed minorants, and if g ^ — oo ; then there are x* G X*\{0} and r G IR 
such that 

Vx £ X : x* (x) < g (x) . 

Proof. If g is g = +00 or = —00, then g(x) = 0*_ 1 or g(x) = 0* for all x G X, respectively. 
Thus, let us assume dom g ^ and g ^ —00. Since dom g is a closed convex subset of X it 
is the intersection of all closed half spaces including it. Each such half space has the form 

{i£l:i*(i)-r<0}3 dom g (5.4) 

for some x* G X* , r G IR. The function x* : X — >• IR certainly is a closed improper affine 
minorant of g. Since dom g is the intersection of all domi* with x*, r satisfying (|5.4p the 
result follows. □ 

The next result characterizes improper affine minorants of improper IR A -valued functions. 

Theorem 5.7 Let g: X — > IR A . The following statements are equivalent for £ G X A and 
r G IR: 

(oj VxeX: S r (x)<g(x), 

(b) sup x6X {£ r (x) --5 (x)} < 0, 

(c) sup x6X {| r (x) +. (-1) 3 (s)} < ; 

(d) mi x< z X {9 (x) -£ r (x)} > 0, 

(e) inf.ex {g(x)+. (-l)^(x)} > 0. 

Moreover, if £ = x* with x* G X* then (a) through (e) are equivalent to 

(f) domi* ^ dom g, 

and the suprema in (b), (c) are —00 whereas the infima in (d), (e) are +00. 

Proof. The equivalence of (a) and (b) follows from (|3.13|) . The equivalence of (b) and 
(c) is immediate from (|3,14p . Likewise, (d) and (e) are equivalent. The equivalence of (b) 
and (d) follows from and 

If £ = x* then the difference x* (x) — g (x) is +00 if and only if x 6 dom g\dom x* , so (b) 
and (f) are equivalent. □ 

The previous theorem together with the effect described in example 14.51 gives rise to the 
following definition. 

Definition 5.8 The Legendre- Fenchel conjugate of g: X — > IR A is the function g* : X A x 
IR — > IR V which is given by 

g* (f,r) = sup {£ r (x) -g{x)} . 

xex 

for^G X A , r G IR. 
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Take x* G X* and r G IR. Of course, 

g* (x*, r) = sup {x* (x) — g (x)\ = sup {x* (x) — 5 (x)} — r = g* (x*) — r 

where g* (x*) is the classical Legendre-Fenchel conjugate of g at x* G X*. Moreover (compare 
the previous theorem), 

* /£* r) = J -°° : domi;(-)Ddom 5 , 
1 +00 : otherwise. 

Therefore, £ r with £ € X A , r G IR is a (proper or improper) closed affine minorant of g if and 
only if g* (£, r) < 0. 

Proposition 5.9 Let g: X — > IR A 6e a function, (£, r) G X A x IR. 77ie following equivalent 

statements are true: 

(a) The Young-Fenchel inequality 

VxGX: S r (x)--g{x) < g* (£;r). 

VxGX: ^ r (x) < 5 (x)+- 5 * (£;r). 

VxGX: £ r (x)-- 5 * (fcr) <g(x). 

Proof. The first equation is immediate from the definition on the conjugate. For (b) and 
(c), recall r— s < t is equivalent to r < s+'t (see theorem 12. 1( (a)). This gives the equivalence 
of (a) with (b) and (c), respectively. □ 

Many of the known rules for the manipulation of conjugates apply also to g* at improper 
elements. There are, however, some differences. We shall indicate one of them, a rule for 
conjugates of an infimal convolution which is defined for f,g:X—> IR A (see |14j ) as 

(fUg) (x) = inf {/ (x{) +' g (x 2 ) : X\ + x 2 = x) . 

Theorem 5.10 Let f, g : X -> IR A and £ G X A , r G IR. Then 

(/□</)* (£, r) = sup {/* (£, n) +. 5* & r 2 ) : n + r 2 = r} . (5.6) 

Tjf, m particular, £ = x* G X* t/ien 

(/□</)* (x*,r) = /* (**,0) +.5* (x*,0) +. (-r) . (5.7) 

Proof. From the first formula in (d) of proposition 13.61 we obtain 

(/□<?)* (£,r)= sup (Ux + y)-- (f(x)+-g(y))). 

x,y£X 
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From (|4.ip and (|3.7p . (|3.14p we may conclude 

(/□<7)*(£,r)= sup ( SUp (H ri ( X ) + ^ r2 (y)) ± (-l)(f( X ) + -g(y))) 
x,y£X \ri+r 2 =r / 



sup ( (£ n (*)+. tr 2 (y)) +. (-1) (/(*)+" g(y))) 



x,y£X 
ri+r2=xo 



Using proposition 13.31 we get 

(fn g )*(t,r)= sup ((e n (x)+.^ 2 (y))+.((-i)/(x)+.(-i) 5 (y))) 



x,y&X 

ri+n=r 
sup 

ri+V2=r 



((^(x)+.(-l)/(x))+.(^(y)+.(-l) 5 (y))). 



Again (|3.14p yields 



(/□<?)* (£,r)= sup ((e ri (x)--/(x))+. (er 2 (y)--5(y)))- 

ri+r2=r 

Taking the supremum with respect to x while applying the second part of (|3.7f) . and then 
doing the same with the supremum with respect to y we arrive at 

(/□ 9 )*(£,r)= sup (/*(£, n)+. Ur 2 (y)--fl(y))) 

ri+r2=r 

= sup (r(e,n)+.5*(e,r 2 )). 

r\+r2=r 

This completes the proof. □ 

Remark 5.11 Taking r = in (|5.7|) and observing that g* (x*,0) = g* (x*) is the classical 
Legendre-Fenchel conjugate we arrive at the correct version of theorem 2.3.1, (ix) in \2J$ . 
See already Moreau's paper paragraph 6.h. 



Remark 5.12 Surprisingly, the right hand side of (|5.6p turns out to be the supremal con- 
volution of the conjugates of f and g - with respect to the real variable r. One may observe 
once again that conjugation via the formula given in definition \5.8\ changes the image space: 
+. has to be used on the right hand side of (|5,6p whereas +' appears on the left hand side. 

Definition 5.13 The Legendre-Fenchel biconjugate of g: X — > 1R A is the function g** : X — > 
1R A which is given by 

g** (x) = sup {f r (x) -g* (£,r)} 

(£,r)gX v xIR 

for x £ X . 

Theorem 5.14 Let g: X — > 1R A be closed convex. Then g = g** . 
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Proof. Note that for x* G X* and r G IR we have 

** / \ . \_ f +°° • x & dom x* and dom g C dom x* , . 

r- l x J 3 l x > r J — I _ QO . otherwise ^ ' ' 

and 

x* (x) — ' g* (x* , r ) = x* (x) — g* (x* , 0) . (5-9) 

If epi<? = 0, then g**(x) = g(x) = +oo for all x G X. If epig ^ 0, then g is the pointwise 
supremum of its affine minorants. Especially, if g is improper, then it is the pointwise 
supremum of its improper affine minorants, thus by (j5.8j) g**(x) = g (x) holds for all 
If g is proper, then the well-known biconjugation theorem (see e.g. [241 theorem 2.3.3]) 
combined with (15.91) delivers the desired result. □ 



Remark 5.15 The closed convex hull of g: X — > IR A is defined by 

Vx G X: (clcog)(x) = inf {t G IR: (x,t) G clco (epig)} . 

Since the conjugate of an arbitrary function coincides with the conjugate of its closed convex 
hull, the biconjugate of the function yields precisely the closed convex hull. 



The well-known relationship between the subdifferential and the Fenchel conjugate can 
be extended to the improper case as follows. 

Proposition 5.16 Let g: X — > IR A be a convex function and xq G dom g. Then, the follow- 
ing statements are equivalent for £ = x* G X* , r = x*(xq): 

(a) t;ed e *g(xo), 

(b) dom£ r I) dom g, 

(c) Vx G X: (£ r (x) -' g (x)) +■ g (x ) < & (0) = -oo. 

(d) g* (£,r) = -oc. 

Proof. It holds Cx*(x )( x ) = t,i x ~ x o) for all x G X. Moreover, £ x *f Xo )(x) = — oo if 
x*(x) < x*(xo) and £ x *(x )( x ) = +°° otherwise, (a) (b) can be checked directly, (a) 4$ (d) 
is formula ()5.5j) . (d) (c) is clear from the definition of g* , while (c) and "not (b)" produce 
a contradiction. □ 

Proposition 5.17 Let g: X IR A be a convex function and xq G X. If xq G" doing, then 
d ex g(xo) = {— oo}. If xq G domg, then 

d ex g (x ) = {£ e ^ A : g* (£, x* (x )) +' </ (*„) < £ (0)} . 

PROOF. Assume x G doing. First, if £ = x* G X* then £ (0) = -oo. If £ G d ex g(x ) 
then proposition 15.161 (d) gives g* (£, x* (xo)) = — oo, hence 5* (£, x*(xo)) +'5 (xo) < £(0). 
If £ satisfies the latter inequality, then, by definition of g*, also the one in proposition 
15.161 (c), hence £ G d ex g(xo). Secondly, let £ = x* G X*. Then g is proper (otherwise 
dg (xo) = <9 e:E <? (xo) n X* = and g* (£,x*(xo)) = +00), and the result is well-known since 
g* (£, x* (x )) = g* (x*) - x* (x ) in this case. □ 

We close this subsection by noting that the theory in sections 5.1, 5.2 has a symmetric 
counterpart for functions mapping into IR V which requires modified definitions. For example, 
Moreau [HJ p. 10], already introduced the sup-convolution for IR v -valued functions. 
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5.3 Set-valued convex and concave functions 
5.3.1 Image spaces 

Let Z be a topological linear space and V (Z) the collection of all subsets of Z including 0. 
Let C C Z be a convex cone including £ Z. We shall write z\ <c ^2 for Z2 — Z\ E C, and this 
defines a reflexive, transitive relation. The relation <c can be extended in two different ways 
to V (Z), see for example [7], [8] for details and references. A basic idea in these references is 
to use the equivalence classes in V (Z) of the extension of <c to construct appropriate image 
spaces for set- valued functions. It turned out (see [8]) that the following sets are appropriate 
choices as image spaces for set-valued closed convex (concave) functions: 

Q t c {Z) = {ACZ: A = clco {A + C)} and 
Qf (Z) = {ACZ: A = clco (A-C)}. 

We redefine the addition for elements A, B of Q l c (Z) and Qp (Z) and the multiplication with 
e IR by 

A®B = cl (A + B) (5.10) 

and • A = cl C in Q l c (Z) and • A = -cl C in Qp (Z), respectively. Then, (0, (Z) , 0, -, d) 
and (Qp (Z) , ©, •, c) are partially ordered conlinear spaces. Again, the multiplication with 
— 1, transforming (Z) into Qp (Z) and vice versa, is a duality in the sense of [23] • We 
shall abbreviate Q A = (Q£, (Z) , ©, •, d) and Q v = (Qp (Z) , ©, •, c) . The advantage of 
using these image spaces compared to other, more common approaches in vector and set 
optimization is that they are partially ordered lattices with formulas for inf and sup as given 
below. Moreover, inf and sup in these spaces are not "utopia elements", but they are strongly 
related to known extremality concepts based on minimal/maximal points with respect to <c 
or set relations. Compare [7], [9] and, most notably, the discussion in [TU] , 

Proposition 5.18 (a) Let A C Q A and B G Q A . Then 

inf A = cl co (J A, sup A = H A 

AeA A&A 

and 

inf A © B = inf (A © {B}) , sup A © S C sup (.4 © {-B}) . 
(b) Let iCQ v andB e Q v . Then 

sup 4 = cl co (J A, inf 4 = n ^4 

and 

sup 4 © 5 = sup (4 © {£>}) , inf 4 © B C inf (4 © {5}) . 

T/ie addition for sets of sets is defined as A® {B} = {A © B : A £ 4} is non-empty and 
A® B = otherwise. 



18 



Proof. Exemplarily, we add the proof of infimum-additivity in Q A . Indeed, for A Q Q L 
and B G Q A we have 



iniA®B 




I co |J A j 5 = 0160 U (A B) = inf (.4 {B}) 



Since the roles of inf and sup are exchanged in Q v , the supremum-additivity in Q v follows 
directly. The other results are essentially a consequence of the definitions of inf, sup and ©. 

□ 

In view of the theorems 12.11 12.21 the previous proposition tells us that Q A and Q v are 
order complete residuated lattices. Note that is the greatest element in Q A and the least 
in Q v . In both cases, it dominates the addition which is in complete analogy with +oo 
dominating the inf- addition in 1R A and — oo the sup-addition in 1R V . The residuation can be 
used to define a difference for sets. 

Definition 5.19 Let A,BeQ A . The set 

A-B = inf {M G Q A : A D B ® M) = {z G Z : B + {z} C A} (5.11) 
is called the inf- difference of A and B. Likewise, for A,B£ Q v the set 

A-B = sup{M G Q v : B@M C A) = {z G Z: B + {z} C A} (5.12) 

lis called the sup- difference of A and B. 

The reader may wonder why we use the same expression for the difference in Q A and Q v 
which is not the case in IR A and 1R V . Of course, the reason is that we use different order 
relations, namely 3 in Q A and C in Q v and therefore, the infimum in Q A is a union as it 
is the supremum in Q v . We had the same effect if we would use < in IR A and > in 1R V . 
However, note that A-B G Q A for A,B G Q A while A-B G Q v for A,B G Q v , so A-B 
and A— B look very different in general. 

From now on, let X and Z be separated, locally convex spaces with topological duals X* 
and Z*, respectively. The (negative) dual cone of C is the set 

C~ = {z* G Z* : Vz G C: z* (z) < 0} . 

It is well-known (and a consequence of a separation argument) that sets A G Q A , B G Q v 
can be described dually as 



p| IzeZ: M -z* (a) < -z* (z)\ , 

2 *€C-\{0} ' 

B= Pi IzeZ: -z*(z) <sup-z* (6)1 



2*ec-\{o} 

respectively. The above representation of elements in Q A and Q v can be used to characterize 
the set differences from definition 15. 191 in terms of support functions. For define the 

extended real- valued functions cfjj : Z* — > 1R A , crj : Z* — > 1R V by 

^ (z*) = inf -z* (z) , ol (z*) = sup -z* (z) . 
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Proposition 5.20 (a) For all A,B G Q A , 

A--B= f| {z G Z: a% (z*) a B (z*) < -z* (z)} . 
z*ec-\{o} 

In particular, if A = {z G Z : (z*) < —z*(z)} for z* G C~\ {0}, then 
A-'B = {z G Z: a% (z*) -a% (z*) < -z* (z)} . 

(b) For allA,B G Q v , 

A-B= □ i z ^ Z -- -z*(z)<al(z*)-.*l(z*)}. 

z*ec-\{o} 

In particular, if A = {z G Z : — z*(z) < a\ (z*)} for z* G C~\ {0}, then 
A-B = {zeZ: -z*{z)<a\ (z*) - a y B (z*)} . 

Proof, (a) By definition of A-B, a% (z*) < cr B+z {z*) whenever z G A-B, and 
a B+z ( z *) = a% (z*) +-z* {-z) for all z* G C~\{0}. Thus, a% (z*) -■ a B (z*) < -z*(z). 

On the other hand, take z G Z such that a% (z*) - a B (z*) < -z* (z) for all z* G C~\ {0} 
and assume z ^ A— B. Then there is b G B such that z + b £ A. A separation argument 
produces z* G C"\{0} and t G IR such that -z* (b + z) < t < a% (z*). Since a B (z*) < 
—z* (6) we may conclude — z* (z) < a 1 ^ (z*) — a B (z*), a contradiction. 

If, additionally, A = {z G Z : a% (z*) < -z* (z)} with z* G C~\ {0} and a% (z*) -■ a% (z*) < 
-z* (z) for z G Z, then a% (z*) < -z* (b + z) for all b G B, thus B + z C A. 

(b) is proven with parallel arguments. □ 

From proposition 15.201 we immediately obtain for all A,B C Q A and z* G C^\{0} 

a%_. B {z*)>a% (z*)--v% (z*) 

with equality if A = {z G Z : (z*) < — z*(z)}. A parallel relationship holds for elements of 
Q v and 

Remark 5.21 For z* G Z* we set H (z*) = {z G Z : z* (z) < 0}. The additional assumption 
in proposition \5.2(A (a) is equivalent to A(B H (z*) = A since 

A®H{z*) = {z£Z: ip% {A) < -z*{z)} . 

5.3.2 Set-valued functions and their scalar representation 

The graph of a function f-.X—^V (Z) is the set 

graph/ = {(x,z) G X x Z: ze f (x)} , 
and the effective domain of / is dom / = {i£l:/(i)/(J}, 

Definition 5.22 A function g: X — > Q A is called convex (positively homogenous, closed) iff 
graph g C X x Z is convex (a cone, closed). A positively homogenous convex function into 
Q A is called sublinear. A function h: X — > Q v is called concave (positively homogenous, 
closed) iff graph h C X x Z is a convex (a cone, closed). A positively homogenous concave 
function into Q v is called superlinear. 
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The collection of all convex functions into Q A (Q v ) is a conlinear space under point- wise 
addition and multiplication with non-negative reals. As in the scalar case, it does not make 
much sense to consider convex functions into Q v or concave into Q A . A function g : X — > Q A 
is convex if and only if —g : X — > Q v is concave. 

The next goal is to represent Q A -valued functions by families of IR A -valued ones and, 
likewise, Q v -valued functions by families of IR v -valued ones. Let z* € C~ and g: X — > Q A , 
h: X -> Q v . Define ip^ z « : X — > ]R A and ^ , : X -> IR V , respectively, by 

(^ A * (x) = inf — z* (z) and (x) = sup —z*(z) (5.13) 

for x E A. Note that g is convex if and only if </? A 2 , is convex for all z* € C~, and /i is 
concave if and only if ip^ z , is concave for all z* € C~ , see [22, lemma 3.2.3.]. If z* = then 

A / \ _ / : x G dom g 
^ 9,z * 1 +oo : otherwise. 

Moreover, — ^P- g>z * (x) = Vg,z» ( x ) f° r an ^ £ A. From the dual description of elements of 
Q A , Q v the following formulas are immediate for functions g: X — > Q A , h: X — >■ Q v : 

Vx G A : ^ (x) = 1^ {zeZ: V ^(x)<-z*(z)} (5.14) 
z*ec*-\{o} 

VxGA:/i(x) = p| - z* (z) < ^, (i)} . (5.15) 

2*ec-\{o} 

These formulas tell us that Q A - and Q v -valued functions can be represented by families of 
extended real- valued functions. In general, the scalarizations may behave "very badly". 

Example 5.23 Let the set IR 2 be ordered by the cone C = M 2 + , z* = (0, -1) and g : IR -> IR 2 

be defined as g(x) = {(^,0)} + C if x > 0, and g{x) = otherwise. Then, <fg :Z *(0) = +oo, 
while ifg z *{x) = holds for all x > and thus cl9? A 2 »(0) = 0. 

The above example shows that the scalarizations fg )Z * of a closed function need not be 
closed. However, one can restrict the scalarizations to closed ones as already shown in [22\ 
proposition 3.3.5]. 

Proposition 5.24 Let g: X — )• Q A and h: X — > Q v be a closed convex and a closed concave 
function, respectively. Then 

VxGA: 5 (x)= P {zGZ: (cl<p A z *)(x)<-z*(z)} (5.16) 
2*ec*-\{o} 

Vx€A:/i(x) = P {z£Z: - z* (z) < (cl i^ 2 ,) (x)} . (5.17) 

z*ec-\{o} 

Proof. A function h: X — > Q v is closed and concave if and only if —h: X — >• Q A is closed 
and convex. Thus, it is sufficient to prove the statement for convex functions. Let g: X —¥ Q A 
be closed and convex. If graph g = 0, then there is nothing to prove. Let (xq,zq) £ graphg. 
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Then by a separation argument in X x Z there exists (x*,z*) G (X* x Z*)\{(0,0)} and 
t G K such that 

-x*(x ) - z*(z ) < t < inf (-x*{x) - z*(z)) . 

(a;,2)Ggraph g 

Obviously, z* G C~ and 

VxGX: x*(x) - (x*(x ) + z*(z )) < x*(x) + t < inf (-z*(z)) = ip A z *(x). 

z&g(x) 

Thus, x i — y x*(x) + t is an affine minorant of cl<£> A z * and 

z i {z G Z : ip A z *(x ) < ~z*{z)} • 

This proves 3 in (j5. 16|) . and the converse inclusion is trivial. □ 

A function g : X — >■ Q A is called proper (C-proper) if dom / 7^ and f (x) ^ Z (/ (x) 7^ 
/ (x) — C) holds for all € X. A function g: X — > Q A is proper (C-proper) if and only if 
there exists at least one z* G C~\ {0} (z* G C _ \ — C~) such that <£g i2 * : X — > IR A is proper. 
However, even if g is C-proper, not all scalarizations are proper in general. 

Example 5.25 Let Z = IR 2 , C = clcone {c} with c = (0, 1) T . Ta&e z^ = (0, -1) T G IR 2 
and define a function g : IR — >• Q A 6?/ 



' ^(4) = {^G1R 2 : (^) T z<o} 



C 



x > 

x = 
x < 



T/ien 5 is convex C-proper, and <fg Z * '■ X — >• IR A is proper if and only if z* is collinear with 
Zq . Moreover, the function g is not completely characterized by its proper scalarizations since 
g (0) = C C H(zl) holds. 

The previous example shows that while analyzing set-valued functions, improper scalar 
functions appear naturally. Providing a calculus on the space of improper functions allows a 
unified approach to the theory of set-valued functions via scalarization. 

5.3.3 Conafnne proper and improper functions 

In the remaining two sections we focus on the convex case mentioning that the corresponding 
constructions for the concave one are easily obtained. 

Definition 5.26 Let x* G X* , z* G C~ . The function St* ,.v X -4 Q A given by 

Sfa tZ * } (x) = {zeZ:x* (x) + z* (z)<0} 
for x G X is called an lower conlinear function. 
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Obviously, ST., z ^ (x) = —S A X *, (x) for x G X is the corresponding upper conlinear 
function to be used in the concave case. For each z* ^ 0, the functions S£ * „.,, 57* *\ are 

' ' (x*^*) 1 (X*,Z*) 

" finite- valued" in the sense that they attain neither the value Z nor 0. 

It is easy to find situations in which SA* ^ is C-proper, but its scalarization with Zq is 
improper (in which case Zq is not collinear with z*). Of course, the scalarization with z* is 
linear if z* ^ 0. If z* = 0, then the scalarization of a lower conlinear function is x* . 

For each z* G Z*\{0}, there is a one-to-one correspondence between functions x* G X* 
and iSA, ^ : X — > Q A . The situation is different for z* = 0, see remark [5.281 below. 

In the same way as we extended the definition of affine functions from real-valued to 
extended real- valued ones we extend the definition of conlinear functions. 

Definition 5.27 Let £ G X A and r G HI. We define the functions rz *y. X -> Q A by 

S^ r>z * ) (x) = {zeZ:t; r (x)<-z*(z)} 

for x £ X. Each such function is called a (closed) conaffine function. If r = it is called a 
(closed) conlinear function. 

Of course, a Q A -valued conaffine function is proper if and only if z* ^ and £ G X* . 

Remark 5.28 Let z* G Z* , £ = x* G X* and r G IR. Then 

Vx G X: S£ M) (x) = {zGZ: x* r (x) < -z*(z)} 

Z : x* (x) < (44> x G domx*) 
: x* (x) > xg'domx*) 

= S(x*,r,0)( X )- 

This means, one can replace x* by x* and z* by G Z* , and in this way the case z* = 
"includes" all improper cases. In particular, 

VtGX-S a M-izGZ- r*M <0\- I Z '■ ^W<0(**^domf*) 

Vxex.b (xr>0) {x)-{zez.x (x)<0}-| . ,, (a;)>0(o ^ domf) 

Consequently, we obtain a one-to-one correspondence between the set of improper affine 

scalar functions x* : X — > 1R A and the set of conaffine functions Sh* : X — > Q A . Note that 

r [x* ,r,0) ^ 

many of those scalar and set-valued functions coincide since x* = tx* for t > 0. 
Finally, we turn to scalarizations of proper and improper conaffine functions. 

Proposition 5.29 Let z*,z% G Z*\{0}, x* £ X* , r £ JR. Then 

w a (r) _( -oc : Vt>0: 3*^**0 

= (x) = x*,(x). (5.19) 

(a:*,r,0)' (:E*,r,0)' 

Proof. Obvious from the definition in (I5.13p . □ 
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5.3.4 Legendre Fenchel conjugates of set-valued functions 

Let £ G X A , r eTR, z* e C~\{0}. The function ^ : X -> Q A is a closed conaffine 
minor ant of 5 : X — > Q A if and only if 

(5.20) 

The following result runs parallel to theorem 15,61 It should be clear how to formulate the 
counterpart for concave functions. 

Theorem 5.30 Let g: X — >• Q A be improper closed convex. Then g is the pointwise supre- 
mum of its improper closed conaffine minorants, that is 

Vx G X: g{x) = f] {sfe,^ (x) : (x*,r,z*) G X* x M x C~\{0} : (IO0]l is satisfied} . 

(5.21) 

In particular, if g ^ Z, then there are x* G X*\ {0}, z* G C \ {0} anc? r G 1R such that 

yxeX:S^^ ) (x)^g(x). (5.22) 

Proof. The theorem is trivial if g = Z and g = %. Let us assume that <? is different 
from these two functions. In this case, domg 7^ is a closed convex set and g = Z on doing 
(see proposition 5 in [8]). Hence dome? is the intersection of non-trivial closed half spaces 
including it. Each such half space is generated by some x* G X* \ {0}, r G IR, and it is easily 
seen with the help of remark [5.281 that the corresponding Sh.* r z ^ satisfies (|5.22p with an 
arbitrary z* G C~\{0}. □ 

The "proper/C-proper" version of this theorem is theorem 1 in [8]: g: X — > Q A is closed, 
convex and proper, or identically Z or 0, if and only if g is the pointwise supremum of its 
proper conaffine minorants (that is, with z* G C~\{0}). Therefore, a closed convex function 
with values in Q A is the pointwise supremum of its conaffine closed minorants. The next 
result is the set- valued counterpart of theorem 15.71 

Theorem 5.31 Let g: X — >■ Q A and £ G X A , z* G C~\{0}. The following statements are 
equivalent: 

(a) Vx G X: Sfe rz ^ (x) D g (x), i.e. Sji rz *\ is a closed conaffine minorant of g, 

(b) Vx G X: £ r (x) < Pg tZ * i-e. £ r is an affine minorant of ip A z *, 

(c) (<p* g .y(t,r)<0, 

(d) sup (x) --9 (x) : x G X) D H (z*). 

Moreover, if £ = x* with x* G X* , then (a) through (d) are equivalent to 

(e) domx* D doing, 

and the supremum in (d) is Z. 

Proof. (a)=>(b): By assumption, 

VxGX:^ A (x)<^,(x). (5.23) 

If z* 7^ then, by definition of Sh TZ *y 

. (x) = m({-z* (z) : (i r (x) < -z* (z)} = f r (x) 

(€>»■>**)' 



24 



for each x G X. Now, (b) follows from ([5T23]) . If z* = then <^ (x) = J d omg (x) and 

A , x _ f +00 : £ r (or) > 

^cW oW I : £ r (x)<0 

With this, (b) is immediate from (|5,23D , 

(b) =^(c): We have 

(C,r) = sup {£ r (x) --^ . (x)} < sup {£ r (x) (*)} < 

where the first inequality follows with the help of proposition 13.61 (b), second formula, and 
the second inequality with the help of proposition 13.61 (a). 

(c) =>(d): If z* ^ we obtain from proposition 15.201 (a) with A = r z ^ (x), a\ (z*) = 
£ r (x) and B = g (x) 

S {£,r,z*) (x)-g(x) = {z £ Z: i T (x) -(fg,z* 0*0 < ~ z * 0)} ■ 

Consequently, 

fl [ S ir,z-)to-'9{xj\ =lzeZ: sup [M*) <-**(*)} 

= {zeZ: (^Y(C,r)<-z*(z)}. 



The desired implication follows since H (z*) = {z G Z : < —z* (z)}. 

(d)=^(a): By assumption, H (z*) C iz G Z : g (x) + {z} C S^,^ (x)| for all x G X. 
Since G H (z*), this implies 5 (x) C S 1 ^ r 2 *, (x) for all x G X which is (a). 

Finally, if £ = x*, the equivalence of (a) and (e) follows from remark T5. 281 □ 

The previous theorem motivates the following definition of set- valued conjugates for func- 
tions g: X — > Q A . In contrast to [8], we define Q A -valued conjugates via a supremum instead 
negative conjugates via an infimum. The definition below is also slightly different from the 
one given in [22J, but uses the same basic idea, namely the set difference. 

Definition 5.32 The Legendre-Fenchel conjugate g* : X A x E x C~ — > Q A of a function 
g: X — >• Q A is the function g* : X A xEx C~ — > Q A defined by 



g*&r,z*)= H (S^ rt ^x)--g{x)). 



By remark \5. 281 it holds 

\/{x*,r,z*) G X* x M x C~ : g*(x*, r, z*) = g*(x*, r, 0*). (5.24) 



The definition of the conjugate together with theorem 15.311 produces the following scalar- 
ization formula for conjugates 

g*(Z,r,z*) = {zeZ: (^)* &r) < -z*(z)} (5.25) 
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for all £ G X A , r G IR, z* G C~. 

Most rules for manipulating conjugates carry over from the scalar case. In particular, if 
r = 0, £ = x* G X* and 6 C~\ {0}, then all classic duality results from the scalar theory 
can be proven for the set-valued case as well, compare [8], [22], [9]. 

We will close this section illustrating the previous statement using the biconjugation 
theorem as an example. If g: X — > Q A is a function, its biconjugate is defined to be 

Vx€X:g**(x)= f] (x) g* (£, r, z*j) . (5.26) 

The function g** : X — > Q A maps indeed into Q A and is closed and convex. By equation 
(HlMD , it holds 

VxGX: f(,)= p| (%, z .)(x)--<?*(e,r,z*)). (5.27) 
(C,r)eX A xIR, 

z*ec-\{o} 

Theorem 5.33 Ze£ g: X —> Q A be closed and convex. Then g** = g. 
Proof. According to proposition 15.241 we have 

VxGX:g(x)= f| {z E Z: (c\^ z „) (x) < -z* (z)} , 

2*6C~\{0} 

and </?g jZ . is convex for all z* G C~\{0}. Applying theorem 15.141 to cl^ 2 * we obtain 
Mx^X:g{x) = f| {z G Z: (^V)** (s) < -z* (z)} 

z*£C-\{0} 

= fl {zGZ: (er(x)-'(^.)*(f. »•))<-«*(*)}■ 
(5,r)eX A xR 

2*ec~\{o} 

On the other hand, by formula (^25l) for all x G X and (f,r,z*) G X A x R x C _ \ {0} it 
holds 

%,,*)0*)--3*(£,r) = f^: %, z ,)(x) 5 <?*(£, r) + 

= {z G Z: < (^)*&r) +■(-**(*))} . 

Thus, in view of formula ()5.27|) the statement is proven. □ 

Remark 5.34 Defining the closed convex hull cl cog of an arbitrary function g: X — > Q A &?/ 
graph (clcog) = clco (graphs) we can draw the same conclusion as in the scalar case since, 
as in the scalar case, the conjugate of g coincides with the one of clco g (see e.g. (|5.25j) ). 
namely g** = clco g. 
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6 Appendix 

6.1 Power sets of linear spaces 

Let Z be a linear space and V (Z) the set of all subsets of Z including the empty set. The 
usual Minkowski addition of two sets A,BC\Z 

A + B = {a + b: a G A, b G B] 

is extended to V (Z) by setting A + B = if A = or B = 0, or both. If B = {z} is a 
singleton, we abbreviate A + B = A + {z} = A + z. 

The point-wise multiplication of a set A C Z by a non-negative £ G IR 

t ■ A = {ta: a £ A} 

is extended to V (Z) by setting £-0 = for all i > 0, and finally • = {0} where the first 
is in IR, the second in Z. Finally, we write A — B for A + (-B). 

6.2 Conlinear spaces 

The following definition is taken from [7] where references and more material about structural 
properties of conlinear spaces can be found. 

Definition 6.1 A nonempty set W together with two algebraic operations +: W x W —> W 
and ■ : IR+ x W —> W is called a conlinear space provided that 
(CI) (W,+) is a commutative monoid with neutral element 9, 

( C2) (i) \/w\,W2 G W , Vr G IR+: r • (w% + W2) = T ■ W\ + r ■ u>2, (ii) G W, Vr, s G IR + : 
s ■ (r • w) = (rs) ■ w, (Hi) Vw G W: 1 ■ w = w, (iv) • 9 = 6 . 

An element w EW is called a convex element of the conlinear space W if 

Vs, t>0: (s + t)-w = s- w + t- w. 

A conlinear space (W, +,•) together with a partial order H on W (a reflexive, antisym- 
metric, transitive relation) is called ordered conlinear space provided that (iv) w,w\,W2 G W, 
w\ ■< u>2 imply w\ + w < W2 + w, (v) Wi, W2 G W, w\ ■< W2, r G IR+ imply r • w\ <r ■ W2- 
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